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_g ■ Abstract 

Olkin and Shepp (2005, J. Statist. Plann. Inference, vol. 130, pp. 351-358) 
OO ' presented a matrix form of Chernoff 's inequality for Normal and Gamma (uni- 

variate) distributions. We extend and generalize this result, proving Poincare- 
type and Bessel-type inequalities, for matrices of arbitrary order and for a 
large class of distributions. 
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1 Introduction 

^ ■ Let Z he a standard Normal random variable (r.v.) and assume that gi,...,gp are 

T^-j- ■ absolutely continuous, real-valued, functions of Z, each with finite variance (with 

'nI" , respect to Z). Olkin and Shepp (2005) presented a matrix extension of Chernoff 's 

\ variance inequality, which reads as follows: 

m . 

O ' Olkin and Sepp (2005). \i D = D{g) is the covariance matrix of the random vector 

g = (gi(Z), . . . ,gp{Z))^, where 't' denotes transpose, and if E[(7^(Z)]^ < oo for all 
i = 1,2, . . . ,p, then 

X : D<H, 

^ ■ where H = H{g) = (E[g'-{Z)gj{Z)])py^p, and the inequality is considered in the sense 

" " " of Loewner ordering, that is, the matrix H — D is nonnegative definite. 

In this note we extend and generalize this inequality for a large family of discrete 
and continuous r.v.'s. Specifically, our results apply to any r.v. X according to one 
of the following definitions (c.f. [1]). 

Definition 1. (Integrated Pearson Family). Let X be an r.v. with probability 
density function (p.d.f.) / and finite mean /i = E(X). We say that X follows the 
Integrated Pearson distribution IP(/i; 5, /3, 7), X ~ IP(/i; 5, /3, 7), if there exists a 
quadratic q{x) = 5x^ + /3x -|- 7 (with 13,6,'j E R, \6\ + + I7I > 0) such that 

f {jj- t)f{t)dt = q{x)f{x) for all x G R. (1) 
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Definition 2. (Cumulative Ord Family). Let X be an integer- valued r.v. with finite 
mean fi and assume that p{k) = P(X = k), k G Z, is the probabiUty mass function 
(p.m.f.) of X. We say that X follows the Cumulative Ord distribution CO(/i.; 6, (3, 7), 
X ~ C0(//; S, /3, 7), if there exists a quadratic q{j) — Sj"^ + Pj + ^ (with /3,S,^ E R, 
+ \P\ + ItI > 0) such that 

^(/x - k)p{k) = q{j)p{j) for all j G Z. (2) 

k<j 

It is well known that the commonly used distributions are members of the above 
families, e.g. Normal, Gamma, Beta, F and t distributions belong to the Integrated 
Pearson family, while Poisson, Binomial, Pascal (Negative Binomial) and Hyper- 
geometric distribution are members of the Cumulative Ord family. Therefore, the 
results of the present note also improve and unify the corresponding bounds for Beta 
r.v.'s, given by Prakasa Rao (2006) and Wei and Zhang (2009). 

2 Matrix variance inequalities of Poincare and Bessel type 
2.1 Continuous Case 

In this subsection we shall make use of the following notations. 

Assume that X ~ lP{lJ>; S, (3, 7) and denote by q{x) — Sx"^ + /3a; + 7 its quadratic. 
It is known that, under (1), the support J = J{X) = {a; G R : f{x) > 0} is a (finite 
or infinite) open interval, say J{X) = {a,u) — see [1], [2]. 

For a fixed integer nG {1,2,...} we shall denote by 'H^{X) the class of functions 
(yf : (a, cj) — 7> R satisfying the following properties: 

Hi: For each A; G {0, 1, . . . , n - 1}, g^^'^ (with 5(0) = g) is an absolutely continuous 
function with derivative g^^~^^\ 

H2: For each k G {0,1,..., n}, ¥.[q^{X){g^^\X)f] < 00. 

Also, for a fixed integer n G {1,2, . . .} we shall denote by B^{X) the class of 
functions (jf : (a,w) — )■ R satisfying the following properties: 

Bi: Var[c/(X)] < 00. 

B2: For each A; G {0, 1, . . . , n - 1}, y(^) (with c/(°) = g) is an absolutely continuous 
function with derivative g^'^^^y 

B3: For each k G {0,1,..., n}, 'E[q'' {X)\g^''\X)\] < 00. 

Clearly, if EjXp" < 00 then ?/"(X) C i3"(X) (note that H2 (with k = 0) yields Bi), 
since by the C-S inequality, E2[g*^(A:)|c/(*=)(A:)|] < E[q''{X)] ■ E[q''{X){g(''\X)f]. 

Consider now any p functions gi, . . . , gp G 'H'^{X) and set g = {gi, g2, ■ ■ . , gp)^. 
Then, the following p x p matrices — Hk{g) are well-defined for k — 1,2, ... ,n: 

Hu = {K,,k), where %fc:=E[g^(X)^f(X)5f(X)], ^, j = 1, 2, . . . ,p. (3) 
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Similarly, for any functions gi, . . . ,gp G B^{X), the following p x p matrices — 
Bk{g) are well-defined for A; = 1, 2, . . . , n: 

Bk^{kj.,k), where kj-^ :^ nqHX)g?\x)] ■ E[q\X)gf\x)], i, j ^ 1,2, . . . ,p. 

(4) 

Our first result concerns a class of Poincare-type matrix variance bounds, as 
follows: 

Theorem 1. Let X ~ IP(/^; S, 7) and assume that E|Xp"^ < 00 for some fixed inte- 
ger n G {1, 2, . . .}. Let gi, . . . , gphe arbitrary functions in H"'{X) and denote hj D = 
D{g) the dispersion matrix of the random vector g = g{X) = (gi(X), . . . ,gp(X))^. 
Also, denote by Sn = Sn{g) the p x p matrix 

where the matrices Hk, k = 1,2, . . . ,n, are defined by (3). Then, the matrix 

An = (-1)"(D - Sn) 

is nonnegative definite. Moreover, A„ is positive definite unless there exist constants 
Ci, . . . ,Cp G R, not all zero, such that the function Cigi{x) -|- • • • -|- Cpgp{x) is a 
polynomial (in x) of degree at most n. 

Proof: Fix c = (ci, . . . , Cp)^ G and define the function hc{x) = ■ g{x) = 
cigi{x) -|- • • • -|- Cpgp{x). Since gi, . . . , gp G l-L^^X) we see that the function he belongs 
to 1-L^{X) and, in particular, hc{X) has finite variance and E,[q''{X){hQ\x)Y] < 00, 
k — 1,2 ... ,n. Thus, we can make use of the inequality (see [1], [5]; c.f. [4], [7]) 

{-inV^rhciX) - Sn] > 0, where S^^J^ , , ^t!!'"' . mq\X){hP{X)n 

in which the equality holds if and only if he is a polynomial of degree at most n. It is 
well-known that Vaihc{X) = c^Dc and it is easily seen that E[q''{X){h'c\x)f] = 
c^HkC with Hk {k = l,...,n) as in (3). Thus, Sn = c^SnC and the preceding 
inequality takes the form 

ct[(_i)"(D_5„)]c>0. 

Since c G R^ is arbitrary it follows that the matrix (— l)"(iD — S^) is nonnegative def- 
inite. Clearly the inequahty is strict for all c G R^ for which he ^ spam[l, x, . . . , x"]. 
□ 

Remark 1. (a) Olkin and Shepp's (2005) matrix inequalities are particular cases of 
Theorem 1 for n = 1 and with X being a standard Normal or a Gamma r.v. For 
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example, when n = 1 and X = Z ~ N{0, 1) = IP(0; 0, 0, 1) then Si = Hi = H = 
{'E[gl{Z)gj{Z)])pxp and we get the inequahty D < H {in the Loewner ordering). 
Moreover, for X = Z and n = 2 or 3, Theorem 1 yields the new matrix variance 
bounds H - < D e^nd D < H - ^H2 + |if3 where H2 = {'E[g'/{Z)g]{Z)])py,p 
and H, = {E[g'/'{Z)g'J'{Z)]Up. 

(b) Theorem 1 applies to Beta r.v.'s. In particular, when n — 1 and X ~Beta(a, b) 
(with p.d.f. f{x) oc x°'~^{l — x)^~^, < a; < 1, and parameters a,b > 0) then 
q{x) = x(l — x)/{a + b). Theorem 1 yields the inequality D < H {in the Loewner 
ordering) where H = -^(ElX {l—X)g!j^{X)gj{X)])pxp. This compares with Theorem 
4.1 in Prakasa Rao (2006); c.f. Wei and Zhang (2009), Remark 1. 

Next we show some similar Bessel-type matrix variance bounds. The particular 
case of a Beta r.v. is covered by Theorem 1 of Wei and Zhang (2009). 

Theorem 2. Let X ~ IP(/Li; 6, (3, 7) and assume that E|Xp" < 00 for some fixed inte- 
ger n E {1,2. . . .}. Let gi, . . . , gphc arbitrary functions in i3"(X) and denote hj D = 
D{g) the dispersion matrix of the random vector g = g{X) = {gi{X), . . . ,gp{X))^. 
Also, denote by Ln = Ln{g) the p x p matrix 

n ^ 

^"^I^A;! nci'{xmf=f-iii-j5)'^'' 

where the matrices B^, k — 1,2, . . . ,n, are defined by (4). Then, 

Ln<D 

in the Loewner ordering. Moreover, D — Z„ is positive definite unless there exist 
constants Ci, . . . , Cp G K, not all zero, such that the function Cigi{x) + • • • + Cpgp{x) 
is a polynomial (in x) of degree at most n. 

Proof: Fix c = {ci, . . . , Cp)^ G R,^ and, as in the previous proof, define the 
function hc{x) = ■ g{x) = cigi{x) + ■ — h Cpgp{x). Since gi, ■ ■ ■ , gp E i3"(X) we see 
that the function he belongs to i3"(X). In particular, hc{X) has finite variance and 
E[g'^(X)|/i^H-'^)|] < 00, k = 1,2 . . . ,n. Thus, we can apply the inequality (see [2]) 

YarhciX) > L„, where L„ = V ^'[q'{X)h^^\x)] 

in which the equality holds if and only if he is a polynomial of degree at most 
n. Observe that Varhc{X) = c^Dc and E'^[q'' {X)\h'c\x)\] = c^BkC with Bk 
(/c = 1, . . . , n) as in (4). Thus, L„ = c^LnC and the preceding inequality takes the 
form 

[D - L„] c > 0. 

Since c G is arbitrary it follows that the matrix D — Ln is nonnegative definite. 
Clearly the inequahty is strict for all c G for which he ^ spam[l, x,. . . ,x'^]. □ 
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2.2 Discrete Case 



In this subsection we shall make use of the following notations. 

Assume that X ~ CO(/i; 5, ^5, 7). It is known (see [1], [2]) that, under (2), 
the support J = J{X) = {k & li : p{k) > 0} is a (finite of infinite) interval of 
integers, say J{X) = {a, a + 1, . . . ,u — l,uj}. Write q{x) = 6x^ + /3a; + 7 for 
the quadratic of X and let q^''^{x) = q{x)q{x + !)••• q{x + k — 1) for k = 1,2,... 
(with q'^^\x) = 1, q^^\x) = q{x)). For any function : Z — >■ R we shall denote 
by A''[g{x)] its A;-th forward difference, i.e., A^[^(x)] = A[A'=-^[^(a;)]], A; = 1,2, . . ., 
with A[g{x)] = g{x + 1) - g{x) and AO[^(x)] = g{x). 

For a fixed integer nG{l,2,...}we shall denote by H2{X) the class of functions 

g : J{X) — )■ R satisfying the following property: 

HDi: For each k G {0, 1, . . . , n}, E[gW(X)(A'=[c/(X)])2] < 00. 

Also, for a fixed integer n G {1,2, . . .} we shall denote by B2{X) the class of 
functions g : J{X) — )• R satisfying the following properties: 

BDi: Var[^(X)] < 00. 

BD2: For each k G {0,1,..., n}, E[g'=(X)|A'=[^(X)]|] < 00. 

Clearly, if EjXp" < 00 then n^{X) C i3^(X) (note that HDi (with k = 0) 
yields BDi). Indeed, since F[q^^\X) > 0] = 1, the C-S inequahty implies that 
E2[gW(X)|A'=[(?(X)]|] < E[gW(X)] ■ E[gW(X)(A'=[(?(X)])2]. 

Consider now any p functions g^, . . . ,gp G T-L^i.^) ^^^1 set g = {gi,g2, ■ ■ ■ , Qp)^ ■ 
Then, the following pxp matrices = Hk{g) are well-defined for A; = 1, 2, . . . , n: 



i?fe = (%;fe), where /i,,;^ := E[/1(X)A'=[^,(X)]A^[5,-(X)]], i, j = 1, 2, . . . ,p. (5) 



Similarly, for any functions gi, . . . ,gp G B2{X), the following p x p matrices — 
Bk{g) are well-defined for A; = 1, 2, . . . , n: 



The matrix variance inequalities for the discrete case are summarized in the 
following theorem; its proof, being the same as in the continuous case, is omitted. 

Theorem 3. Let X ~ C0(//;5, ^,7) and assume that E|Xp" < 00 for some fixed 
integer n G (1, 2, . . .}. 

(a) Let gi,...,gp be arbitrary functions in 'H^(X) and denote hj D = D{g) the 
dispersion matrix of the random vector g — g{X) — [gi{X), . . . ,gp{X))^ . Also, 
denote by S„ — Sn{g) the p x p matrix 



Bk = {bij;k), where 

b,,,k := E[q^'\X)A'[g,{X)]] ■ E[q^'\X)A%{X)]], t,j = l,2,...,p. (6) 



n 



(-1) 
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where the matrices H^, k — 1,2, . . . ,n, are defined by (5). Then, the matrix 



Ar, = i-iriD - Sn) 

is nonnegative definite. Moreover, An is positive definite unless there exist constants 
ci, . . . , Cp G R, not all zero, and a polynomial P„ : R — )■ R, of degree at most n, such 
that F[cMX) + ■■■ + CpQpiX) = Pn{X)] = 1. 

(b) Let Qi,. . . ,gp be arbitrary functions in B2{X) and denote hy D — D{g) the 
dispersion matrix of the random vector g — g{X) — {gi{X) , . . . , gp{X))^ . Also, 
denote by L„ = Ln{g) the p x p matrix 

n ^ 

^"^^fc! WKX)]U%lUl-j6)'^'' 
where the matrices Bk, k — 1,2, . . . ,n, are defined by (6). Then, 

Ln<D 

in the Locwner ordering. Moreover, D — Ln is positive definite unless there exist 
constants Ci, . . . ,Cp G R, not all zero, and a polynomial : R ^ R, of degree at 
most n, such that F[cigi{X) H h Cpgp{X) = Pn{X)] = 1. 

[It should be noted that the k-th term in the sum defining the matrix Sn or the matrix 
Lji, above, should be treated as the null matrix, Opxp, whenever E[g[*^](X)] = 0.] 

As an example consider the case where X ~ Poisson(A) with p.m.f. p{k) — 
e-^\^/k\, k = 0,1,... (A > 0). Then X ~ CO(A;0,0,A) so that q{x) = A. 
It follows that Hk = A^(E[A^[^i(X)]A'=[^j-(X)]])pxp and Bk = A2^(E[A^[c/i(X)]] ■ 
E[A'^[(7j(X)]])pxp- Thus, for n = 1 and p = 2 Theorem 3(a) yields the matrix 
inequahty 

/ Var[(?i] Cov[g^,g2] \.J E[{A[g,]f] E[A[g,]A[g2]] \ 
[Cov[g„g2] Varb] J -\nA[g,]A[g,]] n{A[g,]f] J' 
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